Papers with evolutionary search
FENAS: Flexible and Expressive Neural Architecture Search (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent approaches to architecture search have shown good improvements in terms of performance with reasonable training speed. |
| Approach: | They propose an algorithm with more activation functions, input edges, and atomic operations to search for architectures that are optimal for given task. |
| Outcome: | The proposed algorithm reproduces well-known LSTM and GRU architectures and initializes with them for finding architectures more efficiently. |
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models can be used to perform multi-turn response selection, but they can be expensive. |
| Approach: | They propose a framework and a strategy that progressively selects and eliminates unimportant content under context-response dual-attention. |
| Outcome: | The proposed method can effectively speed-up SOTA models without much performance degradation and shows a better trade-off between speed and performance than previous methods. |
Cognitive Alpha Mining via LLM-Driven Code-Based Evolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to finding effective predictive signals from financial data are limited by their complexity and low signal-to-noise ratio. |
| Approach: | They propose a framework that combines code-level alpha representation with LLM-driven reasoning and evolutionary search. |
| Outcome: | The proposed framework combines code-level alpha representation with LLM-driven reasoning and evolutionary search. |
HAT: Hardware-Aware Transformers for Efficient Natural Language Processing (2020.acl-main)
Copied to clipboard
| Challenge: | Extensive experiments on four machine translation tasks demonstrate that HAT can discover efficient models for different hardware (CPU, GPU, IoT device). |
| Approach: | They propose to construct a large design space with arbitrary encoder-decoder attention and heterogeneous layers and then train a SuperTransformer that efficiently produces many SubTransformers with weight sharing. |
| Outcome: | The proposed framework can find efficient models for different hardware (CPU, GPU, IoT device) it achieves 3 speedup, 3.7 smaller size over baseline Transformer; 2.7 speed up, 3.6 smaller sizes over Evolved Transformer with 12,041 less search cost and no performance loss. |
CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challenges (2026.findings-acl)
Copied to clipboard
| Challenge: | Increasing saturation of web data limits further scaling of model intelligence. |
| Approach: | They propose a benchmark to evaluate machine creativity in code generation that combines combinatorial and exploratory creativity through reverse engineering and self-play. |
| Outcome: | The proposed benchmark targets combinatorial and exploratory creativity through reverse engineering and self-play. |